ConCor+: Robust and confident video synchronization using consensus-based Cross-correlation

Consensus-based Cross-correlation (ConCor) is a recently presented algorithm for robust synchronization of noisy and corrupted signals. ConCor has a number of interdependent parameters that need to be set correctly to guarantee good performance. In this paper we analyse the effects of the individual parameters on ConCor’s behaviour and performance. As a second contribution, we show that a parameter sweep with subsequent majority voting can be used to boost ConCor’s performance and produce a trustworthy confidence measure. As a final contribution we show how the proposed extension also allows performing multi-modal (joint audio-video) synchronization of casual multi-perspective video recordings enabling superior matching performance.